Pointwise mutual information Information theory Lexical feature selection http://en.wikipedia.org/wiki/Pointwise_mutual_information